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CONTROL OF INTERCONNECTED AUDIO/VIDEO DEVICES 

5 The present invention relates to systems composed of a plurality of 

devices clustered for the exchange of data, preferably audio and/or video data 
and control messages, via wired or wireless link and, in particular although not 
essentially, to such systems where it is desired to control different ones of the 
devices via a wired or wireless remote control device. The invention further 
10 relates to devices for use in such systems. 

Networking or interconnection of devices has long been known and 
used, starting from basic systems where different system functions have been 
provided by separate units, for example hi-fi or so-called home cinema 

1 5 systems. A development has been the so-called home bus systems where a 
greater variety of products have been linked with a view to providing enhanced 
overall functionality in, for example, domestic audio/video apparatus coupled 
with a home security system and the use of telephone. An example of such a 
home bus system is the domestic digital bus (D2B), the communications 

20 protocols for which have been issued as standard IEC 1030 by the 
International Electrotechnical Commission in Geneva, Switzerland. The D2B 
system provides a single wire control bus to which all devices are interfaced 
with messages carried between the various devices of the system in a 
standardised form of data packet. 

25 A particular problem that can occur with interconnected systems such 

as hi-fi and home cinema, particularly when assembled from components of 
different manufacturers, is the proliferation of remote control devices for 
controlling the respective connected units. One known way in which this 
problem has been tackled is by the provision of an "intelligent" remote control 

30 that can be programmed or reconfigured by a user to operate devices other 
than that for which it was first provided: an example of this is given in United 
States patent 4,626,848 (Ehlers). 
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Whilst a remote control that learns is a step forward, it encounters a 
further problem in terms of the number of control function keys it must carry. In 
effect, the problem becomes one of how to control a first device using remote 
control which does not have all the function keys for that device on it. For 
5 example, in the case of a digital versatile disc (DVD) player to be controlled 
using a remote control intended for a digital television (DTV), a DTV remote 
control is unlikely to have all the necessary DVD keys: while the simple Play, 
Stop, Fast Forward, Rewind and Record keys may be present, other DVD- 
specific buttons like Camera Angle will probably not be present. 

10 Where a large number of functions are required to be controlled from a 

single remote device, one option for keeping the number of physical controls 
down is to have soft keys onto which are mapped selected ones from a 
specific set of functions. An example of such a control mechanism is given in 
United States patent 5,517,257 (Dunn et al) where a four-way selector device 

15 on a remote control selectively has groups of four control features assigned to 
it, with the current assignment at any given time being shown on a television 
or other display screen forming part of the controlled system. Whilst this 
arrangement may help to reduce the numbers of control buttons or switches 
on the remote control, it does require all the mappable functions to be known 

20 and pre-stored. 

It is accordingly an object of the present invention to provide a 
networked system of devices including a facility for control of all devices 
through a single remote control arrangement, which arrangement is capable of 

25 ready adaptation to accommodate new devices with additional features. 

In accordance with the present invention there is provided a local 
communication system comprising a plurality of devices interconnected for the 
communication of data, wherein one of said devices is a display device 
arranged to display data from one or more other devices of the system, and 

30 wherein one of said devices is a remote control device carrying a first group of 
controls for controlling respective operational functions of a device of the 
system, the system including: 
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selector means for identifying a selected device of the system to be 
controlled by user operation of said remote control device; and 

virtual control means to determine which operational functions of said 
selected device do not have a corresponding control on said remote control 
5 device, and generate on said display device a user actuatable simulacrum of a 
control means for each such operational function. 

By generation of the simulacra, which may simply comprise user- 
selectable graphic icons representing the additional functionality, the 
capabilities of the remote control are effectively extended through the 
10 provision of physical controls for functions it was originally designed to 
support, and virtual (i.e. on-screen) controls for functions added subsequently. 

Generation of the simulacrum or simulacra may be handled by the 
display device based on data from said selected device, or by reference to 
stored data, which data is accessed by reference to the device type of the 
15 selected type: alternately, it may be generated by said selected device and 
transmitted as display data to said display device. With this latter 
arrangement, the display device is not required to either hold or acquire data 
defining the simulacra and related functionality - it simply needs to support the 
display of remotely originating icons or simulacra and be configured to indicate 
20 to their originating device when they have been selected by a user. 

Further features and advantages of the present invention are defined in 
the attached claims (the disclosure of which is incorporated herein by 
reference) or will become apparent from reading of the description of preferred 
25 embodiments of the invention, given by way of example only and with 
reference to the accompanying drawings, in which: 

Figure 1 represents a digital versatile disc (DVD) player and digital 
television (DTV) coupled by data link; 

Figure 2 schematically represents the provision of virtual controls from 
30 a first selected device in an interconnected system; and 

Figure 3 shows the change in generated virtual controls when a 
different device in the arrangement of Figure 2 is selected. 
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A first arrangement of interconnected devices is shown in Figure 1, with 
DVD player 10 and DTV 12 being linked via bus 14 supporting communication 
in accordance with IEEE Standard 1394 connect and communications 
protocols. In the following example, reference is made to IEEE 1394, and the 
5 disclosure of the specification of this protocol is incorporated herein by 
re f erence . As will be recognised by the skilled reader, however, conformance 
with this or any other such protocol is not essential to the operation of the 
present invention. 

The functional features of the DVD 10 include a presentation stage 

10 DVD PS16 which reads data from disc 18 and passes it via an encoder and 
decoder stage 20 to output through an interface 22 between the DVD player 
and the 1394 bus 14. From the bus 14, the interface 22 receives control 
commands which it passes to a navigation stage DVD NAV 24 (directing the 
reading of data via presentation stage PS 16), to a player set-up control 26 

15 and optionally, where provided, to a panel subunit PSUnit 28. Control and 
display of control functions for the DVD player is via front panel display 
processor FPDP 30 and remote control device 32, with the display processor 
30 being coupled to navigation 24 and set-up 26 stages. 

Within DTV 12, video signals from the bus 14 are received by an 

20 interface 34 coupled to display screen 36. Also provided is a receiver RCR 38 
for signals from a remote control device 40, which receiver is coupled to a 
command processor CPU 42 which handles not only internal control functions 
for the DTV 12, but also the generation of control commands to be sent to 
DVD 10. In dependence on the means selected for generation of virtual keys, 

25 a key renderer or panel subunit controller DVDK 44 may be provided, as will 
be described in more detail below. In the latter case, an asynchronous link 46 
is provided from the subunit controller DVDK to interface 34. 

As will now be described with reference to Figures 2 and 3, which 
schematically represents the DVD 10 and DTV 12 linked via bus 14 of Figure 

30 1, together with a further device 50 such as a satellite receiver, the 
interconnected devices provide a local communication system, wherein the 
display device 12 is arranged to display data from the other devices 10, 50 of 
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the system. The remote control 40 for the DTV 12 carries a first group of 
controls, as shown by number keys 1..9, 0 together with up/down select keys 
52, audio mute button 54 and seven further function keys indicated as A to G, 
which keys control respective operational functions of DTV 12, such as 
5 volume, contrast and so forth. Control logic of the system, suitably but not 
necessary provided by the DTV command processor 42 (Fig. 1), provides a 
selector means for identifying a selected device of the system 10, 12, 50 to be 
controlled by user operation of the remote control 40. In the example of Figure 
2, the selected device is the DVD player 10 which has operational functions 

10 illustrated as C, D, H, J, K, and L. The functions C and D are common to 
those supported by the DTV 12 (for example contrast and volume) and no 
additional controls are required on remote control 40 to operate these 
functions of the DVD 10 via the bus 14. 

For the remaining control functions H, J, K, and L of DVD 10, the 

15 remote control 40 does not have a suitable control. Instead, control logic of 
the system (again optionally involving command processor 42, together with 
key renderer or panel subunit controller 44), provides a virtual control means 
to determine which operational functions of the user-selected device (DVD 10) 
do not have a corresponding control on the remote control 40. For these 

20 functions H, J, K, L, the control logic generates on the display 36 a user 
actuatable simulacrum - indicated generally at 56 - of a control means for each 
such operational function. These simulacra 56 may be icons displayed on 
screen, optionally overlaying anything currently shown, and may be selected 
by means of the remote control 40, optionally being highlighted (as for J) as 

25 the user operates up/down keys 52 to step through the icons. 

Figure 3 illustrates the case where the selected device is satellite 
receiver 50. Here, device functions D, E, and F are shared with the DTV 12, 
and so only "new" functions L, M and N have simulacra generated on screen 
36, as indicated at 58. As may be seen, function L is common to both DVD 10 

30 and satellite receiver 50: whether any savings may be made in view of this will 
depend on how the simulacra are generated, as will be described below. 

In order to generate the simulacra, there are three options, as follows: 
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1 . Local DVD Key Tenderer in the DTV 

2. Panel Subunit 

3. DVD Player generates OSD for DVD-specific keys 



5 Option 1 - Virtual DVD Keys generated locally in the DTV 12. These 

virtual extra keys are drawn by the DTV on the DTV screen 36 as shown at 56 
in Figure 2, with the user navigating with the DTV navigation keys 52. The 
benefits of this option are that the DTV knows which keys are on its Remote 
Control and therefore knows which virtual keys need to be provided on the 
10 screen. This allows a DTV manufacturer to put more DVD controls on a DTV 
RC if needed, but does not rely on the standardisation of a known set of DVD 
keys on the DTV Remote Control. Also, the virtual key display 56 can be 
moved around on the DTV screen 36 to suit the video content (like the "PIP 
Position" key). 

15 Against these benefits is the requirement for implementation of a 

drawing engine for the DVD display and relatively tight restrictions on 

assigning meanings to different keystrokes and combinations of strokes. 

Option 2 - Panel Subunit. In this option, the look and layout for the 

extra keys (i.e. those DVD keys not present on the DTV RC) are described to 
20 the DTV by the Panel Subunit 28 in the DVD 10. The DTV draws the user 

interface on the screen (using the DTVs Panel Subunit Controller 44) and the 

user has to navigate using the DTV navigation keys. 

This option has benefits in terms of better control over the look and 

layout of the display than option 1 , together with support for manufacturer- 
25 specific keys and multi-function key combinations. As before, the virtual key 

display can be moved around on the DTV screen to suit the video content. 

Against this must be weighed the need for (and cost of) a panel subunit in the 

DVD Player and a panel subunit controller.^ the DTV. 

Option 3 - DVD Player generates OSD for DVD-specific keys. This 
30 uses the existing on-screen display (OSD) generator in the DVD player, the 

DVD generates its own menu or OSD which is rendered in the DVD memory 
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and transferred as a bitmap to the DTV using the 1394 Asynchronous service. 

The user has to navigate with the DTV navigation keys. 

The advantages of this arrangement are minimal impact on the DTV, no 

need for panel subunit, local key renderer, etc. Also, the DVD Player has 
5 complete control over display and uses the existing OSD generator in the DVD 

player. Multi-function key combinations (e.g. right arrow is also Fast Forward) 

may be defined by the DVD manufacturer. 

Against this is the need for extra software in DVD Player, and the need 

for a bitmap to be generated in the DVD player's memory and transferred as a 
10 bitmap. Also, the virtual display is potentially much larger than the simple icon 

display, and it may not be possible for virtual key display to be moved around 

on the DTV screen to suit the video content. 

From reading the present disclosure, other modifications and variations 

will be apparent to persons skilled in the art, including equivalents and 
15 features which are already known in the field of bus-connected and cordless 

communication systems and components and which may be used instead of 

or in addition to features already disclosed herein. 

In the foregoing we have described a local communication system 

which comprises a plurality of devices interconnected for the communication 
20 of data. One of the devices is a display device arranged to display data from 

one or more other devices of the system, and one of said devices is a remote 

control carrying a first group of controls for controlling respective operational 

functions of a device of the system. The system is configured to identify a 

selected device of the system to be controlled by user operation of said 
25 remote control device, and to determine which operational functions of that 

selected device do not have a corresponding control on the remote control. 

For such functions, the system generates on the display device a user 

actuatable simulacrum of a control for that function. 



